South Ohio is a community in the Canadian province of Nova Scotia, located in the Municipality of the District of Yarmouth .